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• PROVIDING COMPARABLE INFORmTION TO PROSPECTIVE STUDENTS: ). 
"""c ISSUES,- PROBLEMS AfJD POSSIBI.E SOLUTIONS 

Oscar-T.'Lenning, Joan S, Stark, and PatriciB Wi^hapt 
The relatively recent establishme/it of federa-l and state programs to . 

r ' • • 

assi$t. Students witf?*educ*ational co'sts has brought the American dream of 
equal agcess to education beyond high schooj closer to reality. Although 
sufficient funds are still' not available to provide full opportunity Tor 
all, only -better comnuni cation about both available assistance and the 
diverge types of postsecondary opportunities" can assure the eventual ' 
achievement of free jchoice as well as. equal access. 



» 4 



In order to. choose among postsecondary options, prospective students 
-♦ . ' ' _ » 

rmjstije able to con^are school^ and programs inji^ht of their needs and 

interests. Studies of student choice indJcate that cost- factors are 
I 

of primary importance. { Kohn et al. , 1974; Christensen, Kedler ar 

» ' ■ • 

T972 ; Davis ahd Van Dusen, 1975). Thus, it is essential to h&^p students 

assess accurately-the net costs of college attendance.^ Us&^is known 

about oth^c criteria ^tudents'use in ehoosjng colleges^'tut it is clear that 

* the- importance of 'other elements i such as parental influence, .student 

ability, curricular prdgrams^, location, .college environment, and 

perceived educational cHJalily, differ for dj^fferent stu^nts. A/wide 

ranpe of comparable information 'necessary to facilitate* choice by a 

■diverse group of pr'ospective students. • • . • . ^ 

".V" In part,, this need, for compar'ab.Te information has been me^-by;a 

' . ' • • " ' -x • 

proliferation of gu/dfebook^ for. the prospective student. Editors of . 

1. ' • • ^ 

such ^u/del^ooks h^ve attetpt*d to provide similar information about 

♦ .*. ■ 

each ^|stltuttof),'~ T4ie ma'jor purpose of the. guide's,, howerver; is' to->>help . 



students. narrow the list of altem^iVe institutjons , rather than to . 
guide the finaT choice. - The final chpfce. from -among .the- selected "possibles'*' 
depends y{|on more detailed- information supplied directly by the institution - 
and by other sources of counsel such as peers parents, co«nselors,. . 
students attending the col-lege, and alumni. ' « */ 

Student decision making in the final stages' of selection is bejieved ' . 
by many to have been hampered because comparable information is not 
supplied by the institutions themselves. Information that utilizes 
common terminoltigy arrived A through consistent procedures is 
lacking. For reasons to be disc-ussed shortTy/the higT^er educatfon coimmn^^ 
has supported "the cwnparison of information by: gufdebook publishers 
but i\as done little to develop acceptable techniques for adequate^ 
compa^rison at the^institutional level, AHhou^h college administratqrs ^ . 
are aiware that students will compare "the infonnation they receive, there • 
have been few atterrpts to cooperate Mn develop^ing , consistent content or 
style. Currently,^ some state and federal agenci6,s have^becocr^ concerned 
about the comparability of information* Institutions have been^calletl upon 
to develop procedures that will facilitate comparison. \, m , 

Recent Attempts at Comparability • . ^ . " 

Althdugh earlier suggestions for presenting c.omparable infonnation ' 
.went largely unheeded,^ four participants in the rlational Task Force on ' % 

"Better Infonnation for Student Choice^ have recently a^empted to determine, ■. 

^Such guidebooks have, however, been criticized 'for n^t ensuring that the ^ 
same procedures and definitions were used in gathering information at each sCTool 

• . ■ _ . * V ■ • • . 

%he Colleoe Board's Commission on Tests discussed .such matters ill l^eS. 

%e National Task Force, supported by The Fund for the Improvement .of 
Postsecondary Education,worked between 1975 and 1977, and involved- eleven 
danonstration -Ijistf tutions and four resource agencies. ~ 
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if ' technifiues for gathgH^g and presenting comparable iriformation* ^ • ^ 
cotlld be developed with cobRerstlog groups of institutions. The four 

* - « > 

attempts to cwnpare infpraation diff§retj considerably in.scop^, in \ 
the techniqufes used, and in tl\e range of institutions involved in 

the effortr " -' •* ■ ■\ " ' ; ' 

»Tj(e College Scholarship -Se^^^ice focused on whatsis sAnetirpes referred 
to as. "access"* information 'of th^\ntost critical type., .They attempted ^ 
to develop coinparable'infonnation^bout costs and financial aid' opportunities, 
at a wide range of schools. 

The Associated Colleger of the f^ldwest, a consortium of litNgral arts 
colleges /'focused on aspects of institutioh^T ''outcomes/ namely^ post-' 
college e?iployment and rates of admission to graduate and professional' 
schools. The project attainted to-dem^strate that already 'fexi sting . 
national sourxes can be utilized to provi'de builtrin comparabtTity. ' ^ 

The ^Syracuse Untve'rsity^Department'of Higher/Postseconda'ry Education 
was ConcenJed^with descfibinq adtjcatipnal ♦'ptocesses'" in which a student 



would participate during th^ .years of attendance. The researchers 



examined existing acade?nic and career^lann 
to write , comparable descriptions for nine 
The fourth agency. The National Center 



1 



SysteFis, iTiclucled alT three types or infoniaii(in ~ access, outcomes, 
and -processes in its work. This project 



Ljng services and a'^eiupt^d 

diverse institutions. 

\ * » * • 

foi*, Hfgher Education ^4anagement 



exploded what information,' 



^ . . : • --. 

pot€^ntj'^lly* availably on campuses but not hurrently provided ^o^prospectivq 

studCTts-^: is useful for students W makina comparisons, and tested scyne^ 



alt6mative methods of^presenting the ideitified information. 




Insights about xomparSbility gained in these four efforts^^ as well 
as- in some o.f the eleven demonstration projects associated with the 
National Task Force, may be oPvalue to others • • Therefore the 
relevant findings ara.disciJssed in'thi,s paper in five categories: 
(1) alternative views about comparability of information; (2) consideration 
'of g^ast and current rfeluctafice of institutions to assist efforts toward 
CQi3it)arabi 1 i ty of information; (3) professiona^obligations to provide 
comparable information to students; (4) accooplishipents and problems 
enountered^bjr the^T^sk Forc^ merrtrers; and '(5) recommendations ^Gr the 
future. ♦ ^ ' 



ALJERKATI\^ VIEWS- OF COMPARABILITY 



Two conflicting views exist concerning the 'use of information about 

two or^more iostttutions for comparison purposes.' ' One view, whjch we ' ^ 

have termed the "comparable information 6its" approach, holds- that true 

comparability requires direct one-to-one comparisons among institutions! 

on specific items qf -information , such as indices or statistics. 

Exactly fhe same items of information must be j3btaindd for eath school; 

all basic pieces of data that^arfe included in . the'rinfohnation item , 

« f " • - • ♦ 

rfiust be defined identically for each school, must be collected during, the: 

4 - - I " 

same time frame us^ theisame techniques, Snd must be combined Jn* the . 
same way to constitute the information item. Similar3y,^n this vfey/, . 
all information items must be presented in the same' format fsr^tH 
institution to facilitate direct comparison. ; ''/r'^^ 

The opposing view is that one can only conpare* *\i\]oie j^ctut^es." 
In^is approach? each institution siiould indepeftdqntTy ^^e/ and present 



. is- 
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in the most appropriate Contextual manner all , irfformation needed to 
descrjibe thMnmtutioh. Th^'the "whole pticttire" formed in' the • ' 
student's inin;i Isnone institution can be compared to, the "whole picture" 
for other inrtitutfons under consideratipn. The picture most attractive 

% « 

• % * * 

1;o.the student which cotnes closest to uieeting his/her iserceived 

needs ~ is thus seleated. In this view, there^^is no concern for 
the ififonnation providet^ ^5) students by mother institutt^ns. The sole 
concern-^is with conveying tq- prospective "students the essence^ of a 
single institution- and its* pra^rams in order ta accurately answer 
questions from prospective students and their advisers. One r^ribnale 
for this approach .is that 'institutonal ci%iarisons depend greatly 
-upon the irrteractions between student values and. their perceptions 
of the institution. As acknowledged^ by l^wrence, Weathersby, Curry 
and Eden ( 1971) . , co<^para'bility lik^ beauty, is in the eye of the 
beholder." " " , ' • 

* A problem -with the "co(riparab^ bits* view is, that while a particular 
vinformation item may accuraWly -describe § giveh aspect of on§ 
institution^ ft may' distort tne same aspect for another institution, 
/or exan^le, comparison of the^percentage of^ entering students Who 
graduate may be misleading when \coniTiunity collets are compared with 
^universities *since (iT^any voca^ional-technicar^tudents 'get attractive 
-job offers prior to graduation arki it is to their \^dvantage to drop out? 
(2) some students who plan to attend four-year colleges and universities 
transfer^at the end of the first i^ear; ^ (3) many- part-time students 
work full Jtime and take two or t^ree times as long to graduate; (4) a 
significant number of students have no intention t)f graduating-^heir 
goal is merely to take certain courses of interest; r ^ 



Another problem -with the "comparable bits" view ii tha]t it focuses 
^^rrtion on. specific aspects of the ihstitiftion fn isolation^from other* 
important aspects. For example, a focus on "financial afd awarded ^ | 
accord^t^g to students' family income" jgnores the fact- thaft^.detemri nation 
0/ financial need commonly involved direct consideration of^i0) to 
forty^roor^istinqt.factors.i A focus on job placement rates ignores ^ 
'the^many oth^r desirable bi^omes of a college education. 
* The- "holistic*^ approach has its problems^ too. It is extremely 
difficult to compare complex **v/holes" without considering how selected ^ 
parts of each whole compare to one another, ft is difficult to get ^ 
a good feel for the wrfoTe lecture at one such complex instituti^, 
let alprie for^ several of being conpared^^ For exan^le>m^^<^tional 
Center for Higher Education Management Systems project staff spent nearly 
a week at each participating, campus visiting with dozens of people and 
examining available information materials. .They felt they had a picture 
of each campus sufftcient'Vy .^alid to aMow comparisons. But^ in comparing 
the campuses aft^r the visits, the discussion necessarily ^iealt with 
one sector or component of each campus "at a time. 'Nevertheless, knowledge 
of the surrounding context on each campus made discussion of particular 
infomtatibn items more meaningful. ^ ■ • 

Another valid criticism of the "wljole picture" approach is that some 

'types of information presented ^or one college may not be available 
— ^ * ^ *^ /"^^ 

for others;! thu? the student may compare ."apples; with orafnges" without 
being aware that this is" so. For e)ample, "one institutioiTtnay discuss 
the„ backgrounds , teaching experiences, and teaching phi^ospphy bf its 
instructors as, a group; another institution m§y give a short background 



capsule sunrtafy separately 'far each instructor (,but omit his teaching 
•pWlos.ophy); and a third institution may Ifst only the names, degree . 

* • • • ' ' . 

cre'dentiau' and subjects of eath instructor. When w-hole pictures are ' 

»■ ' - ' ' ^"^^^ . . 

cotnp;areri, each picture may*? more or less cocnplete or presented in 

- ' ■ . • 

Such {^Ifferent ways that institutional comparisons in regard to a particular. 

factor i€' hindered and the prospective student must work- much harder. . 
If is also more difficult for students to verify information that is ^ 
given in summarized, narrative forn). ^ 

The experiences of the Task Force ^jembers suggest that the desired 

approach to .presenting jnformation^or comparability is an approach 
V * / ^ * ■ » ' f . 4 , 

between the two extreme positioRS that have been presented. ^ A , 

The institution can supplement a data base of information with additional 

.unique information. for a better and/inore complete self*-description^ 

Complete comparabiltty requires compatible data —consistency- - . 

from one institution to another % the definitions an<f procedures . \ 

through which data are developed — and totally compatible data are 

/afely if ever available. because ^ata cqllecti^ involves >iuman judgnent. 

Nevertheless," useful (fata comp^tability can Jdb approached through 

"establishing a fixed structure and dat:a definitions while recommending 

[to institutions] a set of flexible procedures for' collecting data" 

(Gamse and Service, 1976)^ Such a plan will allow both. coinpari sons 

. of discrete types of it>fonn&tion and the development of the entice ^ 

picture, . •* ■ • . • ' . 

fhe same has been shown to be true of an analogous .information exchaoge 
' program at NCHEHS" that has attempted to. tievelop formats and procedures to 
• help institutions share acjjninistrative planning and managementHnfortnation. • 
-The initial "approach to 'sharing management information was similar to the 
"comparable bits'" approach, but NCHEMS leamqd early;that direct comparispns 
must be limited in niimber. '.' - . * 

' ' . ' '10 ' r . 
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Ob ItiSTITlrriOHS OBOECT to PROVIDING COMPARABLE INFORHAXrON? \ 



Colics already provide for, the publication of many kirids of ^ ^ # 

cpmpapable 3ata. ^ Regardless of sponsorship, the various rep\jtable 

guides to colleges depend upon instjttitional cooperation in. furnishing • 

the ihfonnation. The American Council on Education's jnas'siv^ compendium, 

Amerrean Colleges and Universiti&s , The College Eittrance Examination 

Board's College Handbook^ the ijimerican College Testing Ppogram's^ 

Col lege Search/Planning Book , many cooinercial guides, and state-sponsored 

or ;for-profit comput^ized information services all exist only -with . 

institutional cooperation. Furthermore, although many of these guidM, 

year, after year,., have presented "traditional" bits of informatipn ^out * 

colleges, some of them now. venture to present "new" kinds of information 

deemed , useful to *prospe'ctive students, including information on attrition 

rates, percent of students with finanacial heed whose full need is met, 

minority group enrollments and even some student putfioiRe measures. 

Higher education institutions;>hetber enthusiastically or/reluctantly, 

' . - * 4 

continue to meet the demands for everwmore complex types of comparable 

dat* to be used by students at the first or screening stage of college 
choice, * * r ^ 

Undoubtedly most institutions share a reluctance to provide long lists 
of data items when, as* is somelfmes the case, th^ relevant definftions are 
yncl^ar, the time and cost factors are significant, ancL there is 'no check 
on the veracity of the Information supplied by competing Institutions.* 
yhy then, are institutions willing to participate Ui these outside venture.s? 
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' * ^ '. ■ 

A wide variety of expl arv&ti ons- are possible,. Since the higher,, » • 

, * . • , ■ . , i. 

. ■ education- conmunity itself has notdbly failjjl -to'establ'^'sh its own . _ 

procedures, some institutions may f^l tne line. of least resistance - 

Jies- in complyirt5 witfi demands from (Outside .providers. ..Others are 

- convinced that the leaitimate need of students f ol*. comparabTe information 
supercedes^ concerns ewer methodplogy.. Again,, some institutions may be • 

V apprehensive thai their credibility mi^^'^iffer^ ^r' they might be 
oi^rlQoke'd, if they were not jncluded ,in the guidebooks.' For st-iH 
' others, looseness »of definition' and control- and even lack of comprehensiveness 
in current guides may seeci advantageous: an 'institutiorr.can ^ut its ^, 
Ijest foot forward, ayording possibly damaging comparisons that mi'ght 

^ ^result from a jnore structured situation/ . 

* FiMlHy, forfPiy institutions the present two-step system, imperfect 

ats it may be, Ms- stilV regarded as perhaps the best to be expected ancJ 

^ - instftutiorral -autonomy.' There 

JLf at least" the possibility that if a wider rgnge of information were provided 

... • . • / 

-by guidebooks or other first-step means, thfe second-^tep interaction f 

betweea prospective student^and institution might be reduced. Hot 

surprisingly, most institutions woujd regard such. 4 .development's 

,r retrogressive, thneatenijig even greater depersonalizertion'of the adm^issibns 

' process, Institutvons tend to resist any surrender of their responsibility 

for.providing information about ^themselves directly to prospective 

students and the4>PP0^^t"ni ty .it presents for stressing "their best ' * , . 

features! ' / " ' . . ' - \ 

, A review of /admissions literatiire.revea^ls that almost never d6es an , - 



institutton inclyde compaHsons with other institutions irtUs own 



nateriaK -Indeed, to do so is regarded in many circles as unprofessional 

• / - . ' *^ 

Ye^^, inost^s<:hools recognize an fethi/al *aiid professional obligation * * 

to provide certain types. qf comparative data as $id/ to' student 4ecision 



^making. Presently, the college handbooks are the gnimary vehicles, 
available for the difschjarge of •tj^is'^responiaSSatZ^ Thus,- they 
receive widespread' support. 

The question we face, then/ is not wh^Jher institutions object 
to provi'din^ comparable data, /but whether they might be expected to 
object to production of diffefrent typek of comparable data and to ^ 
providing ar least some of tnis information at the local level for 
use in the f inaV stages 'oy decision majcirtg. Regardless- of the^ay 
these iiita are defined -/ wK^ther as "new," "better," "more 'useful ," , 

"morfe Qomprehensive," a certain, amount of skepticism shoulid be ^ ' 

* - ' / • '4 ^ ' ' - 

anticipated from the ^ducational community. Institutions of postsecondary" 

,^ducation c&n be expected to resist attempts to pressure them ' 

into accepting changes. Even if they are involved" in The formulation 

of new types lof information* they will not ^juicJ^ly agree upon what ^ / 

information is "neW," "better," or "more ti$eful," nor on *eonsistent v 

m6ans of gathering and presenting them, • ' 

It^is for such reasons — ^not general intransigence -7 that manjTof ^ 

, « • ■» 

.the recommendations made over six ye§rs ago liy the College Board's 

■ V ■ . ■ - ■ ' ■ 

Commission on Tests ( 1570) are still unrealized. One spetifjc recommendation 
w|s that jnformation prospective s«tudeats receive should incltide (among 
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^ .C.such Items a6 statistics on test-score distributions of 
' ' enterfpg* freshmen; the socioeconomjro and geographic origins of 
, entering freshmen; the number of students who drop out arid transfer 
in^each year ^nd their reasons for doing so, .incJuding the proportion 
^of entering freshmenlwho complete^ college in the normal period; the 
' -numbetj^f each typfe of degree ayardBd; the proportion of graduates 
going on to professional/ schools, graduate schools, and.vapous 
types of occupations ; . • * * , ^ 

Six years later,. demonstration institutions on the National Task 

Forte hav^ begun to provide, and present some'of these recommended 

types of informaffion. Yet even among these pioneering schools there 

was no firm conviction that the infortnation should- be provided in a 

.comp^cabie manner agd relatively little effort was made to do so. • 

Indeed, many Task force-mfembers oppcfsecl a requirement ofvcomparability 

' . '^m } ' ' X 

for the "new types" of information. Each demonstration institutign. 
discovered that, it i^ sometimes costly and time-consuming to produce 
suclfc^formation individually. In. their perceptions, if a comparability 
requirement were acided, t|ie additional compatabi 1 i ty, definitional, 
* and verification piroblems would increase these costs or duplicate them. 
Other concerns expressed by'.institutions, both T as^ F orcfe members ana^ 
others, include: , , ' 



r. Potential acceleration, of ^ the trend toward decreased diversity 

among institutions-^and loss of uniqueness (Ther.e was- also a 

. recognition that the' exact oppo'site effect is po'ssible as 
'. _ i ' .J. 

institutidhs are compared.) ^ ■ 

2. Potential sacrifice of descriptions of many of the aspects , • 

of the institution that ali^ not quantifiable to art undue 



; emphasis those ^hat are. ^ 

■' 3. Potential improper interpretation or incorrect inferences from 
isolated bits, of information supplied.vrithout prope/ safeguards 
' ( Again, there was recognition that improper inferences' are. 

possible with. present Infomiation materials.) 
4. Reluctance to become .involved with comparability that might 

provide another avenue for additional poorly conceived. . . 
• bureaucratic requirements that may or- may not tacilita^;^ ^ 

» _ * 

* . . c » 

V • desired results. • . - . . ^ 

J • - - 

-• V . * . 

t . • ' " ' . ' ' . 

' . THE PROFESSIONAL OBLIGATION TO PROVIDE COMPARABLE INTORMATION 

■ . " . ■ ' • 

■Helny institutional, concerns about misinterpretation and misuse of — 

comparative information are justified. Yet, two pressing considerations 

demand a concertedj if belateil, effort by instituttpns .themselves. First 

and foremost is the obligation to act oh tlie knowledge t^at lack of ^- - 

;compa/^able information' at the final decision stage can, and has,resulted 

in poor student decisions, that are costly to the student, to., the 

institutioa, antf'to society. Sed6nd,*the possibility that^ out s,ide 

' . . * * ° ,' 

^encies will soon 'develop standards of comparability ajjd impose them ' . 

on the postsecondary education community is real; • ^ 

In regard to the educational necessity for coriparable information, 

Task Force members found considerable eviden5e that students depend 

heavily on information from friends and parents^ This-may be t)^, in 



^ pirt* because students find information provided by ^institutions 
. *-to'be irrelevant, difficult to intgrpre:t/and lacking in comparability- . 
' Most advice from .friends and parenrts is given and received on the 



'\ premise that the advisoj^possfesses^nforraatiQn that allows him or h?r 

^ ^ correcrtly infer t^St the ype of education offered a$ a given 

school is appcbpfiate for that s'^6ht\or"i$ of ''good-" or "poor" 

N,^ quality fdr^students 'ijj general. The advice^ m^ be wrong as often 

• ' / as i^ig^t. Thus, in the current two-stefT process of col lege; choice, 

the ffnaVand most important decision of l?en is based .on unidimensional 

•Vankinls by uninformed parties rather thikn on either an adva[nl:ageous 

' presentation by the school of its merits or the careful consideration 

.of the many factors important to an individual student. 
• * * 

instttutions of pos*tsecondary education have long opposed published' 
"qualify" rankings on the grounds that each school has udiqoe features 
easily oveMooked by waters, or on grounds that it is imjjossible 
to'measure educational outcomes accurately, Yet, by abdicating. \ 
resiponsibiiity for comparable information, unidimensional and. even 
biased ratings by both for-profit guide services and well-meaning 
pareots and alumni ^re encouraged. * \" / * ^ 

Indeed, imi^dimensiona'l ratings, whatevjer their source, ara 4 ^ - 
inappropriate today for the diverse group of students and instituttons 
that-comprise. postsecondary education. It is impossible to rank 

. institutions intended to serve differ^t purposes and clienteles on the 
: same' scale, or ^ven to rank institutions with somewhat similar 

missions on a» scale'^ertinent to the educational needs of all students. 
Whil-e the public ha? ac\uir^l 'notions of which colleges are "good" 
and which are "second rat^,'** such global images ^re'of Jtttle value 

.. foe today's students'. Further, io a rapidly changing posts^condary 



s'cehe,' the accepted stereotypes may no longer^be.v^lid; doHeges 

have^a strpng professional .obi igation to encourage students to avoid 

'inviTld judgihents. ^ ; - 

OUning'the last few year?, federal agencies bave moved rapidly-to 

establ.iijh guidelines for cojnp'ara1)1e data. State agencies, concerned 
• , ^ " ■ ^ . . f 

about federal .intrusion on 'a traditional state responsibility, are 
be5inning to fpllcJw: suit. Tfie educational cOTmunity Itself- can be 
pore widely i^nvolved irf the conceptual izati on and practice oCproviding 
<fliore appropriate information standards if some reasonably uniform 
definitions iu6 methocts ftf calculating data Can be devised. Similar 
,types of institutions should^seemingly be. able to find common ground 
for at least partial standardization of items, in the same way that 
they have been williiig to fill in quest ionria^i res for the various*, 
college guides. As diverse requir^ents ^re introduced by outside 
agencies, and as more institutions *adopt varying complex"management 
infformation systems, the task, will become increasingly difficulty 
and more- costly. • * / , • 

With comparability of information as a goal, there shoi>\d be 
an investigatii?n of already existing instruments that might supply 
built-in comparattility. Those data that can be standardized with 
6nly the loss of a^inistratiye convenience should be gradually 
/made uniform; tlfose that cannot be compared without violence to the 
mission of. the institi^tion and tho^e thaJt need special Interpretation 
should be ^refully preserved from standardization, * Unless institutions 
that^are concerned with preserving institutional autonomy begin to 
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attack some'of the simpler problems, the war ma^ be >ost although *the ^ 

battle is won. - ^ . ^ ' . * 

DEVELOPING TECWaQUES FOR- COMPARABfllTY , ' / 



The efforts of the National Task Force agencies'' were m&de in this ' 

context of general reluctance of institutions to provide coit^arable 

IrtYormation, mitigated by a growing recognition that, for both ^ ^ 

professional and expedient reasons, time far ^^ducatprs ,to ac\:- 

had come. None Qf.the agencies ^had author.ity to demand comparable 

data from the institutions' that 'agreed to co^BWte; little; or nio^ 

fand| were provided to institutions that pajticipated inj^^i/research. . 

All participants were free to withdraw i-om the deliberations, at any 

time and som^ did so. * - , / 

« • - 

Resource agencies either gathered data themselves and conducted field 
^sts using samples of students or provided the participating institutions 
with a framework fo^ data gathering and field testing, 'in the field 
tests,. st\jdents were asJ;ed to judge the comparable information presented 
to thdh and to provide feedback about what was most<useful in terms 
of their own characteristics and needs, and in terms of making 
conparlsons salient to th6m. In attempting to test the utility of 
comparable data, the resource agencies deliBerately esdhewed an 
evaluative role. No judgments were made of whether infonfiation that 
^<;ould be provided by the cooperating Institutions might cause 



prospective students to infer t^^t an institution ranked "high'' or "low* 
on *any ^s€ale. Ho attempt was made to construct quality rankings 
either unidimensional or multidimensional . 

IS ^ 



Using these guidelines in testing the utility of cwnparable - , 
information, the resource agencies! paid 'considerable attention to 
inferences that could logically and effectively be 'made from comparative 
data as well as the *in4rences sisjdents. attempted to ma^<e. Similarly, . 
uiich thought was given to -the'-interpretaVi-ons necessary -both 'for 
students to utiliz^ the information to maximum advantage and to 
accomnodatri'ifferences among instilLutions. -Some generalizations 
that emerge^ from these experiences are summarivzed under two main 
categories: ^1) efforts to^ structure comparable information, (2) barriers 



.y 



to comparability. 

9 



Structuring Comparable Information ' ... . 

rfeg College SQ'nclarsnin Ser^jioe prtj^ct developed a Truth-in-Aiding 

Statement that attenpts -to-estabVish ithe minimum information that should 

P • • ^. . 5 

be' communicated to students about cqits and financial aid opportunities. 

The statement has three" levels. The first level describes in nontechnical 

terms the basic qual<^'cations' and/award. conditions for students seelcing* 

r ■ • *' 

aid from federal and state prog raps. Sugh items would. include: 
citizenship, unit course Toad reduirements, class level requirements, 
maximum ayards, minimum awards, /juration of awards, institutional e!igi- 
,bility for participation in f^wral programs^ and application souree. 

Such a s'tatement could be dist/ibuted by federal a^nd state governments as 

6 ■ ' 

a basic source of information about their programs. 



^ The statement has been refined slightly by the National Association of Student 
Financial Aid Administrators and may be recommended for national adoption. ^ . 

'■^Fe.deral law now requires that institutions participating in federal 
assistance programs distribute this information to students. 



Th/secrfnd level is a statement lio* be provided^lDy th^v^ostsecondary 

injtHutions participating 1n federal "student financial ai^ programs. 

11 '.would include the proceeding information and in additioft: 
• / t ' 

-;.^.*^a. a description of anv/l imitations^ that the iiistituticb places 
on eligibility^/ federal aid programs^ ( such as mifiikuOT unit 



} course load, academic progress, renewal conditions, rrtsti tutional 

maxi^num awards): * - 

^ b. a descriptron of all groups and -categories of ^students that 

/ ' are not aided by the institution from federaY funds t-S^ch as 

^ ^. Students seeking a second* bachelor's degree/ unclassified students, 

* participants in continuing education programs); and * 

. ' c* a description of the sU basic budget's usaci'by theXinstitutflon 

I-. ' t " 

in the award of aid and directions for ho^^ to obtain other * 

budgets used b/ the M^nstitLtions beyond th^asic s.,ix t^es. 

This information v/as sugges^d for. di^stribution to every p^c^tential 

or present student who applied for or fnquirerf about financial aid. 

Tlie third level of information is a recommended statement describing . 

. , conparable information about awards made under state ani^ i-nstitutional 

- - student aid Iprograms. Included would be data about the number of 

aid applix:a^its^^The number of a\d alards, the .institutional aid 

packaging policies, and so forth. 

These recommendations are reflacte^ in a- number of the National ' t 

Task Force prospectuses, for example, those developed by Barat .College, 
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Mountain Empire Community College, Macomb Community. College, and the 
University of California at Irvine.^ It appears, however*, that the 



The latter two institutions wbh a national award from the College 
'Entrance Examination Board and Aetna Casualty Company* fdr their ^ 
excellent financial ^id tnforma(1iion. * • . • 
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developmerit^of guidelines fbr*good pfBicttce and the implementation 
of good practice are separate processes. The goaV- of the project 
has been to urge the, student to .Idc*'' beyond gross costs to the 
net expense of a. particular form of education ancl to recognize 
thabthe aim'of financial aid.pfo^rams is not only ^ increase access 
^but t6 introduce parity among. 'Si fferent opportunities. ' ^ 

This exploratory project' has demonstrated that it is necessary 
to have good cofnmwi cation lines between the person preparing the 
information ^or prospective students ar\d the' appropriate ind-lvidual 
in the financial aid office if adequate comparable data are to be 
provided. The lariguage of financial aid is extremely techni?:al and 
therefore difficult to communicate responsibly. Further, the^ ehanges ^ 
in the ava^ilabi 1 ity of fina^ncial atd from year-to-year require^ 
either very frequent up-dating of information or additio^l hedges 
against unavailability of money. In general / however, the project 
Ws successful and a structure has been created through which institutions 
can present comparable data about financial aid. 

ih^ AsQocr^ated Colleges of, the l-Hd^eet sought to demon^rate that 
comparable data on aspects of graduates' fifnployment, earnings, and 
career patterns can be. collected through one or the othef of two ^ 
different methods: (1) 6y using a common survey instrument, or (2) by 
using existing public and quasi-public data- sources. 

For a survey/of the^graduates of the class of 1975,' representatives . 
of eleven of the Associated Colleges designed a questionnaire subsequently 
mailed to all the 1975 graduates at each college. The same procedure 
Vas followed ^or a second questionnaire, sent to graduates of the classes 
of 1970, 1965, and 1960 ( each college surveyed two of these classes). 



. A selected list of Dictionary of Occupational Titles was .included 
the questionnaire, along with space, for write-in titles that 
were later coded foj lowing the same defijirtio/is. Similarly, the 
questionnaire provided a choice af income categories and types of 
employer. By and. large, these methods. appear to have resulted in 
a high-level of comparability^ although Jiad there been ^a pjlot st<jdyV 
certain occupational titles that proved to be popular for liberal 
arts graduates could have been included, reducing the number. of write-ini 
The survey instrumW^^ applicable to all types^^f colleges for 
sel f-studys^and. comparabil ity pur7)oses. * ' 

Although the surveying and datd analysis were oerformed centrally, 
the results are presented by individual Icollege as well as for the 
entire group, %o that each college can compafe the responses of its 
alumni with those of other colleges. 

In another demonstration of comparability, the'^Associated Colleges * 
chose to present, data on the attainment of the Ph.D. degree by graduates 
over a six-year period and had expected to preserrt a sim'ilar analysis 
for«admission to medical and\law schools. To' do this., the ACM Colleges . 
turned, with varying suctess, to information collected and presented ^ 
by outside organizations. The most comp-lete easily obtainable data are 
those on the Ph.D. degree collected by the National Academy of Sciences 
and supplied in computer print-out form. At the time the ACM figures 
were obtained, the print-out shows, all Ph.D. degrees awarded in the 
years 1968-73 by the colleges of undergrackiate origin of the candidates. 
Subsequent figures have now beenjreleased f^r doctorates obtained Mn 1974. 
Because these figures are available for all undergraduate institutions, 
varying kinds of comparison are possible. ACM chose to relate Ph.D's 




obt'aloed by 'graduates of each undergraduate college to the baccalaureate 
degrees awarded. by thaj doLlege. , ^ ■ ' 

Jn the case of medical and law school admission, the situation is 
by nq means open to th^ public gaze. There is no computer print-out 
where one may discover the record for graduates from specific under- 
graduate^colleges. And neither the Association of American Medical Cc^l leges 
(AAMC) nor the Law School Admissions Program of the Educational 
Testing Service can supply data over time, even if requested to do 
so by; a college. - The AAMC, however, ^had published, in the October 1974 
issue of the Joufnal of Medical Education .a showing medical 

school admissions rates by selected undergraduate institutions- They' 
very kindly agreed to supply similar data for ACM colleges .that hadjnot ^ 
beerv included originally. The 'Associated Colleges were thus able to 
produce a table, showing this comparable informatior^. 
^Since that time in 1975 when the ACM colleges first made' their 
request^ the AAMC has revised its procedures. Now any college can, 
upon^ayment of a $15 fee, receive a "Roster of Applicants" showing the 
characteristics of its owrv^appli cants to mfedical schools. At the end 
of the roster, ^there appears a summary of the^^admissions actions' 
taken by, medical schools and by the candidates themselves. The Associated 
Colleges of the Midwest feels that the requests they-— and undoubtedly 
other institutions — made may have facilitated the inauguration of this 
new service. Colleges can in turn, release sucti summary i reformation to 
prospective students if they choose to do so, and it will be comparaBle- 

■ ■ .y 

with thSt of otheF colleges that use the summary report. 



The lSw School Aclmissions Program of ETS does no% now offer such 
a service. ACH, in the course of trying to obtain comparable information, 
urged that the law schools consider such a development, and was assured 
that-our suggestions woyld be given 'consideration at various future 
program committee mee'tings. To test out'the compairability of present 
information, ACH requested* and paid for a trial hand tabulation of 
whatever information was avail abVe about law school applications from 
students at ACM colleges. The resulting tabulation was marred 'by 
the fact that "many of the participating law^ schools do not report back 
lo ETS the ultimate disposition of wait-Tisted and other candidates. 
It is to be hoped that law schools may recognize the merit of imJ)roving 
theii;^data and'offering a service similar to the one supplied by 
the Association of American Medical Colleges. 

The Assotiated Colleges of the Midwest has demonstrated that 
* prospective students can be supplied ^ith meaningfu> cross-ipstitutional 
comparisons CFf the careers and earning patterns of graduates, at 
least for institutions of a similar type'j and in particular for private 
liberal arts colleges like those In ACM. There is a wealth of published 
data* available or actually on the campus, which presumably needs only 
to be put into a con^arable form useful to prospective students and their 
parents. It is deemed* essential , however, that inrtitutlons, prospective 
students, and their parents be made fully a#are of the proper and improper 
inferences that can be drav(n from the data presented. ' - 

/' 

The Syracuse Univereitij Department of Higher/Postseccmdary ^ueation 
compiled comparable *'prospectus-type" information from nine diverse 
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postsecondary institutions. The prospectuses focused on two major c 

educational processes individualized academic progranming artd career 

planning as ^en through pertinent institutional policies and practices. 

Data were collected thrqugh interviews witK administrators, faculty, 

and students, as well as through detailed analyses of college publications. 

Because the colleges were assured of anonymity irf the field, tests^ 

.later conducted, the inv^^stigators were free td write reasonably candid 

descriptions of actual practice. The researchers took 'particular 

care not to malce quality judgments about institutions when writing 

descriptions, it was, however, necessary to make decisions fibout what 

represented re&lUy since all personnel on a given canpus seldom 

x:ontributed identical data and interpretation. 

After struggling with several methods of presenting the info.rmation 

it was acknowledged to be* unwise tcr construct a chart that noted each 

institution as offering or not offering a giswsn service. Such a structured 

format would necessitate frequentsuse of "nat available" or "not applicable 

for smaller schools. Many institutions had little or no data on the 

extent to which students availed themselves-of college services 

pursued available academic and career planning optiorts; therefore charts 

and graphs were not useful modes of presentation. Long narratives 

were judged unsuitable because^ of the risk of researcher bla^ in 

writing. The question and answer format was finally chosen as most clear, 

fair, and comparable. Nevertheless, attempts to compare decentralized 

i , ■ 

policies with scarce documentation while maintaining accuracy marie the 

C • 

comparative descriptions sound vague and nebulous. Fairly detailed 
questions were necessary to allow description of those schools with the 
most elaborate options; consequently, answers often seenied repetiti ve*for 



i • 



-23- 

sraller schools or thase with a limited focus. Proprietary institytions 

ft \ ' ■ 

were difficult to fit into the questi&n and answer format since the 
terms ased and the mode of operation in these institutions differed 
radically from non-profit^ school s. 

It not possvble for every important deviation from official 
policy £o be'noted. An illustrative example is a stat^en^t that 
conmonly appears in college documents: "Faculty are expected to issue 
warnings ^^J^jj^^^tem to stodents who are doing wt)rk below passing 
quality." As stated > this is a perfectly accurate policy statement 
In many institutions. It may be more meaningful to the student,, however, 
to know.whether most faculty fulfill this expectation. Participating 
schools rarely had statistics of this sort, nor did they know how many 
students received such warnings^ They werfTielpful in giving best • 
estimates. True comparability for students seems to Imply that t)\e 
institution .make explicit not only its philosophy and policy 1n such 
matters but sope idea of how the policy actusflly operates. 



f 



/ Four descriptions, wh.ich remained unidentified, were tested with 
enrolled college students and col]ege-bound juniors from three high schools. 

,One finding is that students who perceive themselves as having specific 
needs are likely to view infonration pertinent to those needs as 
particularly iftporjant. For example, students uncertain about career 
choice yiewed career counseling information as particularly Important ^ 
when responding to a checklist of inforratioh items. But'they were not 
necessarilyTtore likely, ^hgn making a hypothetical choice among the 
Institutions described,, to select an institution that offered such services, 
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'Local school atniosphere was inferred from the descriptions* by the 
students in the field test. Thus) "a "hoVistlc" view was fonned from 
the question and answer dfita. Bii.t different/ students placed different 
emphases on the factors that constitute school atmosphere. Some students 
placed heavy emphasis on quality of teaching, while others were more> 
in^rested in flexible rules or the serial environment.- Further, 
motivations for seeking the, same information differed. For example, 
two groups of students desired to know about academic standards on the 

» * 

campus — one group sought to be associated with an academically 
serious group of students, the other group desired to avoid a tiigh 
pressure academic Situation. Thus^ while other Task Force projects 
have stressed .subgroups based on , age, ethnicity, and geographic ori^Vn 
as needing different types of information, the Syracuse researchers^ 
found evidence that student motivation is^alsd a, factor in the "information 
perceived as important. . ' - ' ^ 

* Students made inferences that went far beyoQll what could be 
legitimately inferred. They attributed variance in institutional^^ 
Climate* and esprit to statements of policy and proceduces in^the 
^prospectuses. In discussing a school th^ provided detailed policies 
and procedures , some, students interpreted .this as evidence' of fair 
practice toward students, othei^ as evidence of high academic pressure, 
and still others equated detailed poljicies with institutional rigidity. 
The results of the study indicate that while comparability of educational 
processes, as described ^ poTicies, procedures and student behaviors, • 
is possible, some tff. the uniqueness of each' school may be lost in the 
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descriptions and students~may rnike unwan-anted" fnferences. It is not , 
^ovm, of course, what inferences the s&me student would make from 
traditional information material currently supplied by each institution.^ • 

The national Center fon)yfIiqher Education Management Systems' (HCHE14S) 
gathered over 3300 responses to a College Information Needs Questionnaire 
from high school students, college studertts, parents and counselors. 
In addition, over 500 of these people and various college officials 
ware irtferviewed. Considerable consistency was found among these' 
groups regarding the information perceived as necessary for college;.^ 

Ac 

choice. In the survey, 29 items were considered. either important or 
very important by the majority of respondents in all groups, and ZO other 
items were considered to be important by significant numbers. of respondents. 
Most of the important items clustered into five general categories: 
instruction and instructors, admissions/transfer i^if ormati on , financial 
aid, outcomes, and information relating to program major. Least important 
.was information about enrol led' students. " 

rh working with five of the participating* institutions , NCHEMS found 
that exceplj for outcomes information and student ratings of services 
and instruction, the information considered most important by the 
audiences participating in the survey was generally avatlable. Further, 
institutions said that they were generally willing .to reT^ease these 
items of iaformation to prospective students. • . . 

• . The NCHEMS project also sought to examine the effects on understanding . 
and on comparability of. different ways of presentingthe various information 
items that had been rated as especially important. This was done through 
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administration of a Rating Ways of Presenting Information questionnaire. 

Actual case data were presented in the cjuestionnaire.for twelve of these ^ 

, 'information items, separately for two colleges, A and B, using each of 

five presentation formats: (1) tables of statistics, (2) tables 

With cartoons or caricatures, (3) script paragraphs, (40 question 3nd answer 

and (5) charts and graphs. Several hundred new freshmen at five qutte 

different colleges in different parts o^^the country re54ionded to the ' 

alternative presentations for each item separately In terms of two 

criteria: "Which way of presenting this information is mOst understandable' 

ahd meaningful to jou?" and "In whif:h way of presenting this^type of ^ 

information is it easier to compare College A and College Br^ This was 

only a preliminary exploration using a small sair^le of students, and 

no attempt was made to have the sample representative ( eash college 

was 'asked to choose a diverse sample), but, the results are instructive.' 

The form of presentation roost often used by^colleges in their 

materials, script paragraphs, was judged poorest for both 

'. ' . . ^ 

meaningful ness and comparability. Surprisingly, the highest ratings for * 

most of the items on both meaningfulness and conparability wenfe given 

to tables. For several of the items of information, there were clear 

indications that graphs would definitely aid comparability, and the students 

definite]y seemed to prefer ba^ graphs, over line graphs. There vfere 

/fflsd' indications that different types of students preferred different ^ 
presentation formats — both with regard to meaningfulness and comparability 
each format had. its advocates for all twelve items. 

The NCHEMS results suggest that an institution 'can, *oa its own, 
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Improve the comparability of its information to that of other 
tns^tutions* The results also suggest that factors other than 
content and format lare cri/cjal. For example, defining important 
tenrts used, and having the information piece well organized are important 
criteria. - x '* 

. There -are consistent types of information that, students feel 
Wodltt be helpftfl and attempts to compare these types of information 

V 

shduld receive fir^t attention from colleges. Unfortunately, many of 
the items rated most important, such as ratings of instructors and 
.instruction J are al soothe materials that seem likely to pose the 
•iQreatest difficulty on the campus, both politically and because of 
.^potential misinterpretation* Few of the National Task Force demonstration 
^'institutions attempted to introduce comparability on such items. 

Although homparibili ty was not their major focus, National Task Force 
demon&tration znstituticns conducted cooperative activ^es that 
promoted comparability across the information materials being developed. 
Every three to five months at Task Force meetings, project coordinators 
compared problems-, information under consideration for collection and 
presentation to prospective students, the. composition of potentially 
useful' indice's, (Jefinitions of terms, organization of materials, 
fii^exing techniques to facilitate information use, desirable formats 
vforldifferent types of informatioi\» ahd so forth. They also discussed" 
*^probTeras and issuejS related to comparability with resource agency ^ 

repf6$6ntatives. Influenced by these discussions, some similarities 
;in techniques, format, and content were introduced into a number of 
, the eleven prospectuses. ' . 
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' ' ft should be Emphasized that, in many .instances, concerns about 

providing clearer and more meaningful information, rather than~"c6ncems 
i \ V ' .> . • ^ 

with tryfng' to make -data compara>re, led to improved comparabilHy 
across prospectuses, 'This is .made clear in a TBsk Force resource paper 
by Loe^ (1976):^- 

. . . Similarly, sex and student ability level affect such ^ " 
outcomes as academic and voluntary dropout, and salary level , on 
•the one^andi ^nd retention, graduation, exiting test scores, and 
graduate school acfenission, ^^n the other. Vfhere reports have 
been blocked on variables such as these, the motivation h^s'typically 
been- to provide a clearer picture to the institutiop's students. , 
While a certain degree of interinstitutional conyarabi lity is- the 
■result, we believe that to subdiviiie reports only to providfe 
comparability will have' a negative effect on the student. For 
example,- to make the participating institutions* attrition reports 
potentially comparable would require subgrouping of all of them by • 
■ fi/11- versus part-time, ability level, academic program, and 
re^idmitfed versus continuous. Such subgrouping would be 
- tremendously confusing to any reader, in addition to suffering 
from small sample siz^s. We conclude, then, that standardized 
definitions and reports should not be sought except for items 
of known and major comparative value to students. While supporting 
the goal of cross-institutional comparability, we believe local 
student and institutional needs should govern information selection 
and format. 

"Overall Task Force experiences sugg'fest that there are a number of 
genera.lly aitailable information items that can be compared in a straight- 
forward' and valid manner, even .for dissimilar in^itutions. ^hese 
include head-coOnt enrollments ( subdivided into full- and part-time / 
categories), sex, age distributions, racial/ethnic distributions, 
•geographic distributions of students, percentage of freshmen' receiving 
financial aid of various types { and average awards), typical financial 
aid packages, grade point average distributions, entrance test score 



It should also be noted' that' some Task Force members disagreed with 
the view presented by Loeb^ expressing the view that it will not be 
possible to determine which items can be meaningful to students' when 
presented in a comparable manner until such an experiment is tried 
an<i Student decision malting studied. ' ' . 
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di/Stributiws, tuition and other^costs,- type of coirmunity in which 
the instituti-OB isUocated, available housing, available student . " 

services, "Institiition-^/ide requirements, rules,- regulations, and pqlicies, 

' M ' ^ • ' / 

Other i/istitution-wide Items shoiflH probably only be compared ^ 

— a^rross similar institutfxjns. These inplude percentage of students 

transferring to different types of institutions prior to graduation^ ^ • 

percentage of those graduating who go on to follow-up schooling of 

, different kinds, and percentage who get jobs of various types ♦ 

A college's ranf among a standard and representative ( normed) group 

of their type on data like the ACE freshmen survey can also be a us&ful * ' . 

information item on which to make direct cfrie-to-one comparisons. 

However, it is important that the population bases for these ranks (and 

thts also applies td other student data distributions mentioned 

^ earlier) be specified in an obvious, understandable, and clear manner. 

c 

/ For distribution data from standardized tests to be meaningful 
to a prospective student, it may be necessary to relate the data to the 

type of institution, to the particular program within the institution, 

<? - " 
and to incoming .student abilities, aspirations, and goals, so that the 

input differences in student and program characteristics are'taken into^ 

account. Thus, if the student compares Graduate Record Examination 

scores for the department of business at College A to those for the 

department of business at College B, in the context of other information 

fibout the two departments, their students and their institutional 

environment, th4s' base item of information will more likely be interpreted 

^ correctly. Direct comparisons of -such data can only be really meaningful 

if they are made across similar progralns in similar institutions, or 

across similar fostitutiorR with similar students and programs, 

ERIC 32 



■ J 



• , _ -30- 

Heald College and. the University of California at Los Angeles 



both developed profits -of incoming students that were based on 

the American Council of Educatiorf's annual, surveys, of college freshm^n^ 

^ . . ■ 

Bott) of these profilBs can 'be meaningful and useful to prospective 
-students, and for comparative pulses, when it is realized that 
Heald Coll ege-^ provides a "highly focused program of study"'^ designed 
to train students for a specific job in a short period of time, while 
UCy^'s undergraduate program is largely designed to prepare students 
for advanced professional positions and graduate or professional School/ 

£xcept for items applicable only to an entire institution, 
the NCHEMS project Interviews suggested that it might be useful 
to stud^nt^who have narrowed their choice of a program if th^ types 
of informati4)n already mentioned were available separately by program 
for cross- insKtutional comparison. Similarly, it would be useful 
to major subgroups ^f studetits { older students, major racial/ethnic 
groups, part-time and' full-time students, and by sex) if student distribu 
tfons like tho'se cited eat-lier were made available separately t^y sub- 
.group. For example, Educational |^ortunity program counselors and 
minority s-tydents reported that comparisons on their type- of student 
are particularly useful. . , • 

Even relatively straightf(>rward information items can be misleading 
for some institutions if the basic information is not put in context 
whenever the institution being , described feels that the information 
could be misinterpreted. The emphasis^on particular information items 
in this discussion should not be construejl to contradict the value 
-of combining a"cornparable bits" approach with a "holistic" approach. 



Barriers to Cocnparability 

. The barrier^ to comparing in/ormation that Task Force agencies 
eiicoimtered are not new or unexpected, and some of themliave already 
been mentioned. In fact, most have been readily cited by campus 
adninist/ators in their negative reactions to federal attenpts to ^ 
inipose standa*rdij3;Pcf™ requirements for 'students receiving 
federal ffnancial assistance. The work of the resource agencies did, 
however, delineate many, of these problems more clearly,* and thus, some 
positive steps to inprovi^ng the situation may be suggested. The barriers 
fall into four main categories: (1) those inherent in the orgamzatipnal 
structure of higher educStion; (2) those due to le?l^k of iivailable 
information i (3) those due to diversity among institutional types and 
missions, as wel] as di^sity among students; gjid (4) those ^ue to 
inadequate bases for interpretation of information.^ 

Organizaticnal Structure Postsecondary instUutions , particularly 
non-profit -schools, differ in significant ways from other business and , 
service organizations in American society in the relative autonomy 
accorded the professionals who are employed within thew. Not only are 
faculty members relatively autoriomous and free from administrative 
control in' the way they conduct their teaching and research, but they 
are also closely involved inM'nstitutional govej'nance. The degree of 
autonomy and po/icy-making* involveme^nt differs in different types 
of institutions; i^^s a prominent characteristic of research universities 
' and highly ^elective lil^raVarts colleges* and less prominent in public 
coirmunUy colleges andl proprietary institutions. 

Barriers to comparability are inherent in this decentralized 
governance system. Specifically, the a'utl)nomy of individual faculty 
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members and of the lowest organizational unit, the academic department, 
results in a diversity of operational policies and practices throughout 

tHe canpys and often in the' lack of systematic data collectioR characteristic 

- % 

y . ■ ■ ■ ' • 

^of a loosely structured administt?ative system!' For example, iif- . 
attBnptfng to write comparable descriptions of academic policije^ in 

nine institutions, the Syracuse University resource agency found that: - 

\ 

* The policies concerning a given procedure varied widely even 
within a stngle institution, making it difficult- to state a 
clear instituti^dnal policy that a student could conpa^-e with that 

of another institution. 

< 

• * The mechanisms through which policies a.ctually afe carried out ^ . 
are frequently informal and do not coincide with officially 
stated policies. Thus, clear statements of institutional/ . 
policies may actually be misleading ^o prospective students. 

* Single purpose institutions ( such as. vocational schools) are 
more likely to have clearer policies and operational mechanisms 
than are comprehensive institutions. This is related to their 
more centralized system of control as well. * 

* Institutions that see their roleas individualizing education for 
the syHjdent are less likely to be able to state specific policies. 
Thus, ironically, the institution that intentionally gives more 
attention to the individual student may appear, ^'n a ^comparative 

^ sense J to have nebulous policies or even fewer services when it 
is described in terms of its stated practices. * 
-* Comparability is more easily possible regarding topics, such as 
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dismissal standards, wher/, because- 6f past legal vulnerability, 
the institution .has formul at edf clear statements and centralized 
authority. ^ ' ' ' . 

Ladk of Adequate' Data Lack of ade^gte data is clearly one 'of the 

4 greatest obstacles to comparability encoihrterfed not only by the resource 

agencies^ but also, by the demonstration institutions associated with the 

National Task Farce. Institutions pdssess little statistical data 

about many of their activities, particularly thoSe related to the 

development and achievement of their students. Eyen. fewer data are 

ava'ilable about the activities of faculty and 3taff in contributing 

to student outcome' goals. Recent pressures have been toward accumulating 

♦ 

data relevant to financial decisiorts,.not to curricular or student 

. ■ ' ' r ^ 

development decisions. 

Yet all the resource agencies pointed the way toward the use of 
already existing information: colleges and universities do not need to 
reinve^it the wheel. NCHEHS found that much of the information students 
Maimed they needed was aVail able on its participating dan^uses, having 
been collected for use in administrative dedsiorv making. The ACM 
used a commonly available standardized data source to compare graduate 
and professional school admissions and achievemerfts. The College 
Scholarship Service discovered that information officers were not always^ 
in communication with financial aid officers and that this hindered 
publication of aid information already available. And Syracuse discovered 
that, while much data of the type they were seeking had not been collected, 
the deficiency resul ted 'from lack of concern with the processed under 
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coDsA^rati on -rather than cost or difficulty in getting the information. 

Airong .the demonstration institutions too, similar data were 
available on sever^T^ campuses. Host notable are the results oi well- ' 
known en^ronment surveys: the ACE freshman survey T the Educational 
Testing Service's Institutional Goals Inventory and Institutional 
Functioning Inventory, and results from the College Student Questionnaires 
and the College and University Environment Scales, among others. Even 
now, colleges and miiversities frequently publish selected statistics 
from one or more of these surveys in their s^tudent newspapers or 
alomni roff^zines, often in connection with national norms, to show how 
their institution .compares with others. SimiUcl^^ small groups of 
tnstrtutions share information confidBntial'fy to compare their ♦ 
standings and progress. Examples of such sharing include the former 
College Research Centfer, an ETS- based organization which conducted 
institutional, research for groups of smaM colleges, th^ Council for 
the Advancement of Small Colleges, the ivy League unive^ities , 

the women* s college consortium, and groups' of land-^raht universities 

^ f ■ 

in certain areas. In many states, data concerning all public institutions 

areavailable in a ceritral data bc^k. The next and logical step is. 

to ma4ce this information available to prospective students. 



Vjvereity of Jnetif^ons and Students. The American system of* 
postsecondary education is very diverse. In spite of claims that 
institutions have tended to bec^ome too much alike in their philosophies, 
purposes, governance structures-, and methodologies, the amount -of 
diversity is staggering even within a single type of postsecondary ' 
institution. *Just as the purposes of institutions are diverse, the ' 
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purDoses pf stud^ts in attending a given institution also range 



wioely. The outccxne measures appropriate for a liberal arts college 
''may be just as clearly inappr^riate for a conmurflty csllege. And yet, 

■ - - ^ 

these areas overlap: some vocationally oriented students do attend 

liberal arts colleges and swne students intent on broadening their 

cultural horizons do attend community colleges. Even apparently horno-;^ 

geneous prospective student groups as "adult students," "&1ack students'," 

and "Chicano students" are compo§ed of important subgroups each of which 

has unique educational needs as well as unique iilformation needs. 

Three of the resource agencies producedc^vidence based on subgroups 

of students: NCHEKS examined many subgroup responses to its interview? 

' and questionnaires; CSS specified six different standara financial' 

aid budgets but admitted that individual circumstances might require 

as many as fifty different budgets in making aid decisions; Syracuse 

found that students with different perceivei^ needs valued different 

information in college choice. « 

' Although because of expense, tradition and politics, data bases 

also vary from instibution to institution { and some are firmly entrenched), 
^ \ ' 

^ it would seem possible ^for institutions of similar type to formulate 

* 

several typi>cal stiidefti^ types on the basis of available data. Information 
about previous student successes and outcomes could be geared to those 
basic types, aflthough each student will stijl consider individual factors 
in making decisions/ Presently, information disseminated by institutions 
* is^imed primarily at the "typical" student, but a demarcation of six 
to eight well-founded types might be more 'appropriate* 
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• iKterDretation of Infcvnation , Even if valid, accurate and comparable 
information is provided, students using the informa^tion may mis-interpret. 
it or interpret the same information in different ways. Several, 
of the Task Force projects, for example, found that coiirwn. terms . ^ 
in p6stsecdndary education are aften misunderstood or misinterpreted 
by prospective students. To illustrate, many high school seniors 
interviewed in the NCHEMS project thought thatclass size referred either 
to k^ssroom size or to the -numbers of freshmen, sophonores, juniors, • 
and seniors. -Other colleges found_ th'at students did not understand 
a college major. ' 

Terms c^n be easily defined once they are identified. Other 
'problems are more comple^x. Earlier, we mentioned a nimbe,r of 
information variables that we considered 1;o be "relatively straight-, 
forward and valid to con^are di^ectl>^" These items, however, are 
probably not as crucial to student choice as other, more difficuU 
to interpret informattOniitb^ttTi needs special qualification by the 
institution. Attrition data, mefitioned earlier, is a good example. 
M^ny institutions do not record or report how many graduates are ^ 
re-admitted students { "stop-outs") who were considered drop-outs 
.at an earlier time. Similarly, graduation rates by program may. count 
those who changed majors as drop-outs. If such information is 
properly qualified it could be quite usefuT to' students. 

Other infomation items that require interpretation include: 



'"Difficulties in interpretation jnay explain. why students, counselors 
and others ten^i to downgrade the importance ^f attrition data in several 
of the Task Force surveys. 



changes in major, library adequacy, grading practices, and fiscal 
stability,* These information ite?ns shoul'd not-stand by themselves, 
but should have clarifications in obvious view. • 

• Typ^eS' of information that need even more interpretation than 
those in the preceding paragraph include: attrTtion rates, quality of 
teaching, number of graduate studen^ teaching, almost any kind of 
cf calculated index other than simple percentages (faculty-student ratio, 
total FTE credits, cost per tredit'hour, etc.), and much of 
the quite specific, detailed information that several Task Force 
institutions found that prospective students desire: faculty 
philosophies and workload breakdowns, the "real" bases and cut-off 
points on whicl^ students -are accepted or rejected » These J:ypes t 
of infonpatio/i come closest to needing the "whole picture" presentation. 
And, perhaps even more than with qther items, these descriptions should 
probably only be given for similar program vn similar Institutions. 

Another serious problem, related to interpretation',is "inforrnation 
overload," If several Institutions that a student is considering 
Urovide an abundance pf clarifying information about a; particular index, 
and the clarifications lead in different directions for each institution, 
the student is likely to become confused and frustrated. Institutions 
need to be selective, brief and simple in clarifying the infonnation they 
provide. ' * • 

Ik 

1 

I 

* 4^/ ' - 



OE'LIVE^?ING COMPARABLE INFORMATION? ** RECOMMENDATIONS FOR THE FUTURE 

I 

Published guidebooks give prospective students a variety of 

♦ ' " " ^ " . 

Information about posts^econdary institutions across the country, • 
Sifhilafly^ computerized information systems can help students to 
narrow their institutional options quickly and easily. In general, 
such books and computerized-^^ystems supply a limited number of traditionally 
accepted information items for a large number of colleges. The 
information they cbntain is most useful in the first stages of college 
choice for screening purposes. Currently, each separate guidebook " 
service collects its own information so that colleges- and universities 
are bombarded with'' requests from proprietary companies, non-pn^it service 
agencies and professional, associations, as well as "agencies of 
state aijd federal government. Seemingly, a first step to more adequate 
attention to better information for students and increased efficiency 
for- colleges would be to collect all information through one agency 
that would make it available to the others. 

ft is^clear from Task force studies that students have additional 
4nfonnation Tieeds •of great importance, which surface at a second^on. 

' A- - - ' 

finar selection stage of the college choice process. Once ihe- student 
has* used guidebooks, a computerized system, or other methods to harrow 
doviJ^'the institutions to be considered, more detailed and in-depth 
comparable information is needed for the final choice. , The extensive 
and Varied information distributed annually by institutions 1s often 
inadequate in content or form and varies markedly from institution to 
ins^ltutlpn. Students, parents, and counselors find it .difficult to 



most useful to prospective studepts, specify data from existing 
instruments that could be utilized, and conduct research and 
exploration into problems and issues of comparing information. 
The information should be up-dated regularly, be made available 
to students ir> a timely fashion, be partitioned for important sub- 
groups of students for each college, and be stored in disaggregated 
form so that it can be arranged -and packagec['.in'a multitude of . 
ways to serve the needs of other agencies. » 
Since educational community would assime leadership, liised 
on its traditions of voluntarism.and self-regulation, such 
an agency could lay the groundwork for retrieving fiHw] testing, 
regulatory, governmental and comrorcial agencies the responsibility 
' for providing information to students and institutions* ^ . 

2. The new agency could also provide a neutral critiquing and re- 

ferral service for colleges. Specialists would be available- to 

critique any information materials for students that-a college 

wished to send them, suggesting how the publication ipight be, 

improved. The agency could also make staff members ava^ilable 

at cost fbr on-site consul ting'with colleges or by sending them 

a list of consultants in their area wlio have been trained and - 
» 

certified by the agency"^ qualified to assist. These services 
- could be provided for a small 'fee on frefe of charge, depending - 
upon f|inding arrar^e(nents* 



3. The new agency should publish a college guidebook which will ^ 
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' could be provided for a smalVfee on frefe of charge, depending - 
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3. The new agency should publish a college guide,book which will ^ 
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^demonstrate new types of comparative data for studeht use, 
'it would provide, Tor the first time, a comprehensive, comparative 
view of the Arnerican student experience at identified institutions. 
The guide wuld include any institutioia that agreed to furnish 
designated. types of. information, particularly that concerning 
the nature of the student body, the educational and social 
processes and student outcome measures. Such items might be 
selected from existing national surveys, supplemented by a common 
career or vocational instrument for graduates from each type of 

* ' institution. Funds should be available to institutions demonstrating 
a serious cormiitment to this voluntary effort » but daunted by the 

^ costs involved. While only a few hundred institutions might 
participate ^in the first year, the numbers would likely increase 

" with each subsequent edition of the. guide. 

It is also recofimended that the states use the data base from 
""^th^^ew agency to develop and distribute well -organized and 
effective handbooks that will provide potential students with 
infomation they need about relatively local opportunities. .States 
^could also usefflly develop cooperative relationships with other 
State^in their regian to supply a handbook for local students 
who are considering a regional institution. State commitment to 
and ^^upport of sbch an endeavor would enable the information 



to reach eac)i prospective student in an JnexpensjNfe and manageable 
form for use at home as well as in schools and counseling agenci^. 
It is also recommended that the states develop appropriate com- 
puterized information systems for vocational irtd educational 



'decision making based on the models developed in the U.S.O.E. 
pilot project new underway in eight states. The computer ter- 
minals for thi§''*system, as well as the student handbooks discussed 
above, should be available in public locations in addition to high 
schools. 

In order to develop adequate iirformation for the second stage of 
decision making, colleges and universities will need both assistance 
and added incentives. Governmental agencies and other funders 
should support the development of comprehensive information by'" 
institutions, either through corrmissioned studies or througli 

the agency suggested earlier. Guidelines and suggestions for 

*» 

colleges, beyond what have already been produced by the National 
Task Force, are needed. 

Institutions unquestionably need some incentive system to 
reinforce their professional obligation to help students compare. 
While other motivational techniques may be preferable, monetary 
competitions to select institutions that best typify ideals of 
cbnparable information might be used. Student insistence on more 
comprehensive information, possibly resulting from guides which 
help students ask the right questions, can also be effective. While 
students can become the most importcint {and the roost natural) source 
for ensuring that institutions provide the information needed by 
prospective students, regulations from agencies external to post- 
secondary education that mandate compliance In inflexible ways are 
the least desirable motivational technique. 



The lack of con^arable iflformation &r prospective students can and _ 
has resulte.d in "wrong" student decisions, which are-eostly -to the 
student, the institu|ions and society. Therefore, the strong possibility 
exists that outside agencies will soon impose additional standards of 
comparability on postsecondary institutions. Such externally imposed 
standards may promote homogeneity, may be costly, and*ay 9ive a distorted 
picture to prospective students the precise situation institutions 
hope to'avoid unless institutions initiate cooperative actions. 
Building upon the beginning efforts of the National Task Force on 
Be^r Information for Student Choice, institutions of similar types 

to agree* on some reasonably uniform definitions and methods of/ 
collecting, presenting, and qualifying parrticular items of information 
appropr;i^te to valid educational decisions. 
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CHOICE is A Center for Helping Organizations Improve Choke in 
Education, located in the Department of Higher/Postsecondary Edu- 
cation at Syracuse University and supported by the Fund for the 
Improvement of Posts6condary Education. 

s 

The goals of CHOICE are: 

« 

* to gather and disseminate to institutions current knowledge 
about the contenL-and process of improving information for 
prospective students. 

* to provide technical assistance to institutions seeking to 
review and/or improve the current information they provide 
to prospective students. 

* To evaluate the impact of more comprehensive information 
disseminatiop on student decision-making and institutional 
operations. 

* to facilitate the involvement of institutions in the devel- 
opment of infqj3i}atf6n policy alternatives for use by botfi 
government^T^arid nongovernmental groups. 

'Project Director Assistant Project Director 

Joan S. Stark- Patrick T. Terenzini 

315-423-3701 

Among the longest-established programs of its kind in the country, 
Higher/Postsecondary Education at Syracuse prepares professionals 
for a wide variety of leadership careers in postsecondary education, 
including positions in colleges and universities, federal afid pri- 
vate agencies and foundations, state -boards, consortia, ^rjd educa- 
tional research settings. 

The Department currentl^offers the H.S., Ed.D. and Ph*D. althQugh 
most of the eighty enrolled students are studying for the Ph.D. 
Academic programs include courses from many departments and other 
schools and colleges of the university, including the Maxwell School 
of Citizenship, and the Schools of Public Communication, Law, and 
Management, as well as specialized work in higher education^HSmin- 
istration and research. The faculty includes members of ttjeJJni- 
versity administration and full time scholars In the field. In ad- 
dition to teaching, faculty often have grants for .research and 
development projects, such as Project CHOICE, in which students 
participate-, 



